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(54) One-chip color camera capable of restricting unwanted false color signal 



(57) A CCD portion (1 0) is driven by a driving circuit 
(40) for separately reading out all pixels. Data for 4 lines 
are input in parallel to a two-dimensional register array 
(30) by scanning line delay devices (18-22), and an 
interpolation processing is performed for each of color 
signals G, Mg, Cy and Ye based on data corresponding 

FIG. 1 



to pixels in a 4 row by 4 column matrix. Color difference 
signal generation circuit (36) performs a color separa- 
tion processing based on thus interpolated color sig- 
nals. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates generally to color 
cameras, and more particularly, to a 1-chip color cam- 
era having a color separation circuit for processing sig- 
nals from a solid-state imaging device including 
photoelectric conversion elements arranged in an array 
corresponding to color filters arranged in an array 
according to the color difference sequential system. 

Description of the Background Art 

A CCD (Charge Coupled Device) widely used as an 
imaging device today in a color camera simply changes 
the amplitude of a signal to output depending upon the 
brightness of received light and does not include any 
color information in its output signal. Some device is 
necessary such as using optical means to filter light 
coming into the CCD in order to obtain color informa- 
tion. 

In a color camera for home use, a so-called 1 -chip 
image pickup system to extract three primary color sig- 
nals from a single CCD is employed and a so-called 
simultaneous color imaging system using a color filter 
array on the light receiving side of the CCD is employed. 

Structure of Interline Transfer CCD 

Fig. 10 is a block diagram schematically showing 
the configuration of an interline transfer CCD portion 10 
as an example of CCD generally used in a home use 
color camera. 

Interline transfer CCD portion 10 includes a photo- 
sensitive portion 12 of pn junction type photodiodes 
arranged in an array, a transfer portion 14 including ana- 
log shift registers formed of CCDs, and a horizontal 
transfer register 16 which receives charges transferred 
by transfer portion 14 and transfers signals produced by 
converting a sequentially transferred signal charges into 
voltages for output. 

In Fig. 10, pn junction type photodiodes for three 
pixels are provided in each of the vertical and horizontal 
directions for ease of illustration. In practice, in a CCD 
for use in a color camera, photodiodes corresponding to 
500 pixels in the vertical direction and to 500 to 800 pix- 
els in the horizontal direction are arranged in an array. 

The operation of the CCD portion will be now briefly 
described. 

When light comes into the photodiodes, charges 
are generated and accumulated within the diodes 
Then, the accumulated charges are transferred to ana- 
log shift register 14 at a time by applying a prescribed 
voltage to the shift gate. CCD analog shift register 14 
transfers the charges toward sequential horizontal 



transfer register 16 in response to application of clock 
pulse voltages <|>vi , <t>v2 and <t>v3- Horizontal transfer reg- 
ister 16 converts thus transferred signal charges into 
voltages and then is driven by externally applied hori- 
5 zontal driving signals <t> H i . <t>H2 ^3 to externally out- 
put the voltages as sequential imaging signal outputs. 

Driving Method of Interline Transfer CCD 

w There are generally two modes for driving the inter- 
line transfer CCD portion, in other words modes accord- 
ing to the frame integration method and the field 
integration method. In a color camera, the frame inte- 
gration method, in which all pixels are basically read 

is out, is sometimes used for a color filter array in the color 
difference sequential system. 

Hereinafter, the operation of the interline transfer 
CCD portion in a frame integration mode which permits 
reading on a one-pixel-basis will be considered. 

20 

Method of Separating Color Difference Signals 

Fig. 1 1 is a diagram schematically showing an array 
of color filters arranged according to the color difference 
25 sequential system. 

As shown in Fig. 11, the color filters according to 
the color difference sequential system, color filters for 
magenta (hereinafter simply as Mg), green (G). cyan 
<Cy). and yellow (Ye) are arranged in a mosaic form. 
30 Herein, in mixing optical colors, a so-called additive 
mixing is possible, and therefore the following relation is 
established between three primary colors, red (R), 
green (G), and blue (B) and their complementary colors, 
Mg, Ye. and Cy: 

35 

Mg=R+B (1) 
Ye=R+G (2) 
40 Cy=B+G (3) 

Using the above Mg, G, Ye and Cy as the colors of 
color filters, the intensity of the G signal having the larg- 
est weight relative to the luminance signal among the 
45 three primary colors R, G and B may be set larger than 
that of the R signal or B signal. 

In the example shown in Fig. 1 1 , among a color f fl- 
ter array according to the color difference sequential 
system, an array portion of a 4 row by 4 column matrix 
so is extracted from the color filter array according to the 
color difference sequential system. In the odd rows 
(x=1, 3), G color filters and Mg color filters are alter- 
nately arranged in the horizontal direction (y-direction). 

Meanwhile, in the even rows (x=0, 2). Ye color filters 
55 and Cy color filters are alternately arranged in the hori- 
zontal direction. 

Fig. 12 shows an arrangement of color filters in a 4 
row by 4 column matrix, shifted by 1 pixel in the horizon- 
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tal direction from the arrangement shown in Fig. 1 1 . 

If outputs from photoelectric conversion elements 
are sequentially read out in the y-direction, for example, 
outputs from photoelectric conversion elements for a 4 
row by 4 column matrix read out from the CCD portion 
repeatedly alternately correspond to outputs from the 
color filter array shown in Fig. 1 1 and to outputs from the 
color filter array shown in Fig. 12. In the arrangement of 
the color filters according to the color difference 
sequential system as shown in Fig. 1 1 , the arrangement 
of color filters in an arbitrary 4 row by 4 column matrix is 
any of four arrangements including those shown in Figs. 
11 and 12 and arrangements 1 pixel shifted in the x- 
direction from the arrangements shown in Figs. 11 and 
12. 

Fig. 13 is a diagram showing the concept of a con- 
ventional coior separation method. In Fig. 13, a 2 row by 
2 column matrix is extracted from the arrangement of 
the 4 row by 4 column matrix shown in Fig. 11. In the 
conventional color separation method, a luminance sig- 
nal Y, a first color difference signal Cb and a second 
color difference signal Cr are generated for the central 
position of pixels in the 2 row by 2 column matrix from 
signals corresponding to the pixels in the 2 row by 2 col- 
umn matrix among signals obtained by reading out all 
the pixels in the CCD portion. 

Herein, luminance signal 'Y, first color difference sig- 
nal Cb. and second color difference signal Cr may be 
represented by the following expressions, wherein R, G 
and B represent signal intensities corresponding to the 
three primary colors: 

Y=(Cy+Mg)+(Ye+G) (4) 
= (R+G+2B)+(R+2G)=2R+3G+2B 

Cb= (Cy+Mg)-{Ye+G) (5) 
= (R+G+2B)-(R+2G)=2B-G 

Cr= (Ye+Mg)-(G+Cy) (6) 
= (2R+G+B)-(B+2G)=2R-G 

Therefore, only if signals from the photoelectric 
conversion elements in the 2 row by 2 column matrix 
shown in Fig. 13 are available, luminance signal Y, first 
color difference signal Cb, and second color difference 
signal Cr may be basically obtained, based oh which 
three primary color signals may be separated according 
to the following operations: 

G= (2Y-2Cr-2Cb)/10 (7) 

R=(Y+4Cr-Cb)/10 (8) 

B=(Y-Cr+4Cb)/10 (9) 

The above-described color separation method is 
however encountered with the following problems. 

Fig. 14 is a graph showing the frequency character- 
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istics of output signals Ye+G, Cy+Mg, G+Cy and Ye+Mg 
in the horizontal direction when the conventional coior 
separation method as shown in Fig. 13 is implemented 
using digital filters. 
5 In Fig. 1 3, assuming that signals from the CCD por- 

tion are read out sequentially in the y-direction, signals 
Ye+G and Cy+Mg are generated from signals sampled 
at the same time point, while, for signals G+Cy and 
Ye+Mg, signals from the CCD portion should be held for 
w 1 sampling time period. 

Therefore, the gains of signals Ye+G and Cy+Mg do 
not have frequency dependence, while signals G+Cy 
and Yef Mg have their gains monotonously decreased 
toward the Nyquist frequency. 
15 If the frequency characteristics of signals in the hor- 
izontal direction, based on which the first and second 
color difference signals Cb and Cr are generated, are 
different, an unwanted false color signal is generated, 
which leads to a deterioration in the picture quality. 

20 

SUMMARY OF THE INVENTION 

It is an object of the invention to provide a 1-chip 
color camera capable of controlling color component 
25 signals to have similar band characteristics and restrict- 
ing unwanted false color signals, thereby improving the 
picture quality. 

Another object of the invention is to provide a 1 -chip 
color camera capable of restricting a deterioration in the 
30 resolution if color signal components are controlled to 
be in the same band. 

Briefly stated, a 1-chip digital color camera accord- 
ing to the present invention includes a solid-state imag- 
ing element and a color separation circuit 
35 The solid-state imaging element includes photoe- 
lectric conversion elements corresponding to pixels and 
arranged in an array. The solid-state imaging element 
includes, on the light receiving side, a color filter array in 
which green fitters and first to third complementary color 
40 filters are arranged in a mosaic corresponding to the 
photoelectric conversion elements according to the 
coior difference sequential system. 

The color separation circuit receives the output of 
the solid-state imaging element and produces color 
45 data corresponding to the central position of pixels in an 
arbitrary k row by k column matrix (k:even number). The 
color separation circuit includes color interpolation cir- 
cuits for green and the first to third complimentary colors 
for producing the weighted average of outputs from pho- 
50 toelectric conversion elements, at which corresponding 
color f ilters are provided, among the plurality of photoe- 
lectric conversion elements corresponding to the pixels 
in the k row by k column matrix based on the arrange- 
ment of the color filters and a first operation circuit for 
55 separating color data corresponding to the central posi- 
tion from outputs received from the color interpolation 
circuits. 

Therefore it is a main advantage of the present 
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invention that an interpolation processing is performed 
before a color separation processing, and color compo- 
nents are controlled to be in the same band, so the 
bands of signals Ye+G and Cy+Mg and signals G+Cy 
and Ye+Mg are very much close to each other up to the s 
vicinity of 1/2 the Nyquist frequency, and therefore 
unwanted false color signals in the vicinity of 1/2 the 
Nyquist frequency may be readily reduced. 

Another advantage of the invention is that in gener- 
ating an aperture signal, a deterioration in the resolution io 
caused by an interpolation processing can be restricted. 

The foregoing and other objects, features, aspects 
and advantages of the present invention will become 
more apparent from the following detailed description of 
the present invention when taken in conjunction with the is 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic block diagram of the configu- 20 
ration of a color signal processing system 1000 
according to the invention; 

Figs. 2A to 2E are schematic diagrams for use in 
illustration of an interpolation processing according 
to the invention, wherein Fig. 2A shows a color filter 25 
array arrangement according to the color difference 
sequential system, and Figs. 2B to 2E show . 
arrangements of weighting coefficients used at the 
time of interpolating processings to color signal 
components; 30 
Fig. 3 is a block diagram showing the configuration 
of two-dimensional register array 30 in color signal 
processing system 1000 shown in Fig. 1 ; 
Fig. 4 is a block diagram showing the configuration 
of interpolation processing circuit 34 in color signal 35 
processing system 1 000 shown in Fig. 1 ; 
Fig. - 5 is a graph showing the frequency character- 
istics of color signals according to the invention; 
Fig. 6 is a block diagram showing the configuration 
of color separation circuit 36 in color signal 40 
processing system 1 000 shown in Fig. 1 ; 
Fig. 7 is a first schematic diagram for use in illustra- 
tion of the procedure of generating an aperture sig- 
nal; ■ 

Fig. 8 is a second schematic diagram for use in 45 
illustration of the procedure of generating an aper- 
ture signal; 

Fig. 9 is a block diagram showing the configuration 
of luminance signal generation circuit 32 and aper- 
ture signal generation circuit 38 in color signal so 
processing system 1000 shown in Fig. 1; 
Fig. 10 is a schematic block diagram showing the 
configuration of a CCD portion 10; 
Fig. 1 1 is a schematic diagram showing an example 
of an arrangement of color filters in a 4 row by 4 col- ss 
umn matrix in an arrangement of color filters 
according to the color difference sequential system; 
Fig. 12 is a schematic diagram showing another 



example of an arrangement of color filters in a 4 row 
by 4 column matrix in the arrangement of color fil- 
ters according to the color^difference sequential 
system; 

Fig. 13 is a diagram showing the concept of a con- 
ventional color separation method; and 
Fig. 1 4 is a diagram showing the frequency charac- 
teristics of output signals according to the conven- 
tional separation method. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Fig. 1 is a schematic block diagram showing the 
configuration of a color signal processing system 1000 
including stages from an optical system 2 forming an 
optical image of an object to image at an imaging ele- 
ment, CCD portion 10 to a color separation circuit 100 in 
the configuration of a 1-chip color camera according to 
an embodiment of the invention. 

Color signal processing system 1000 includes an 
optical system 2 which receives light from an object, a 
CCD portion 10 which converts an optical image formed 
by optical system 2 into an electrical signal, a driving cir- 
cuit 40 which drives CCD portion 10 to separately read 
out all pixels, a correlated double sampling circuit (here- 
inafter referred to as CDS circuit) 44 for removing 
noises from an imaging signal received from CCD por- 
tion 10 according to a well known method, an auto gain 
control signal circuit (hereinafter AGC circuit) 46 for 
amplifying the output of CDS circuit 44, an A/D conver- 
sion circuit 48 for converting the output of AGC circuit 46 
into a digital signal, a frame memory 50 for holding out- 
put signals for even lines and output signals for odd 
lines in CCD portion 10 received from A/D conversion 
circuit 48 for 1 image frame in a nested manner, and a 
control circuit 42 which outputs a horizontal address HA 
and a vertical address VA for a pixel from which a signal 
is read out in response to a CCD driving signal from 
driving circuit 40. 

Color signal processing system 1000 further 
includes a scanning line delay device 18 which outputs 
a second input signal produced by delaying a f irst input 
signal from frame memory 50 by 1 scanning line time 
period and a third input signal produced by delaying the 
second input signal by 1 scanning line time period, a 
scanning line delay device 22 which outputs a fourth 
input signal produced by delaying the third input signal 
by 1 scanning line time period, and a color separation 
circuit 100 serving as a two-dimensional non-recursive 
digital filter which receives first to fourth input signals 
and outputs luminance signal Y, first color difference 
signal Cb and second color difference signal Cr. 

Color separation circuit 100 includes a two-dimen- 
sional register array 30 which sequentially receives the 
first to fourth input signals in parallel and holds data 
from pixels in a 4 row by 4 column matrix (including 
green, yellow, cyan and magenta color signals corre- 
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sponding to an arrangement of color filters in the CCD 
portion from which the signals have been read out at 
that point), an interpolation processing circuit 34 which 
receives signals from two-dimensional register array 30 
and produces the weighted average of color signals of s 
each of green, yellow, cyan and magenta to produce a 
color signal corresponding to the central position of the 
pixels in the 4 row by 4 column matrix by interpolation, a 
color difference signal generation circuit 36 for generat- 
ing color difference signals Cb and Cr from the color sig- w 
nals generated by the interpolation, a luminance signal 
generation circuit 32 which receives a signal from two- 
dimensional register array 32 and generates a lumi- 
nance signal Y, and an aperture signal generation circuit 
38 which receives luminance signal Y and a signal from 15 
two-dimensional register array 30 and outputs an aper- 
ture signal AR 

Herein/imaging lenses included in optical system 2 

are generally provided with variable mechanisms for a 

diaphragm function, focusing, zooming and the like. 20 
Color signal processing system 1000 further 

includes an aperture correction circuit 39 for correcting 

an aperture (emphasizing a contour) in response to an 

aperture signal. 

In the above-described structure, the first to fourth, 25 

four kinds of input signals correspond to imaging signals 

for four scanning line (four lines), and are input to color 

separation circuit 1 00 on a 4-line-basis. 

Thus, color separation circuit 100 and the three 

scanning line delay devices 18 to 22 implement an FIR 30 

(Finite Impulse Response) filter. 

Interpolation and Color Separation 

Figs. 2A to 2E are schematic diagrams for use in 3s 
illustration of an interpolation processing according to 
the embodiment of the invention, wherein Fig. 2A shows 
an example of an arrangement of a color filter array in a 
4 row by 4 column matrix, Fig. 2B shows a distribution 
of weighting coefficients at the time of interpolation 40 
processing for the arrangement of magenta color filters 
in Fig. 2A, Fig. 2C shows a distribution of weighting 
coefficients at the time of interpolation processing for 
the arrangement of green filters in. Fig, 2A, Fig. 2B 
shows a distribution of weighting coefficients at the time 45 
of interpolation processing for the arrangement of cyan 
color filters in Fig. 2A, and Fig. 2E shews a distribution 
of weighting coefficients at the time of interpolation 
processing for the arrangement of yellow filters in Fig. 
2A. 50 

More specifically, in this embodiment by an inter- 
polation processing according to the following weighted 
average processing, a magenta signal component, a 
green signal component, a cyan signal component and 
a yellow signal component corresponding to the central 55 
position in the pixels in the 4 row by 4 column matrix are 
generated. 



Mg= 2xMg11+Mg13+Mg31 

G = 2xG12+G10+G32 
Cy= 2xCy21+Cy01+Cy23 
Ye = 2 x Ye 22+Ye 02+Ye 20 



(10) 

(11) 
(12) 
(13) 



Note that, as described in conjunction with Figs. 11 
and 12, there are four kinds of arrangements of color fil- 
ters corresponding to pixels in a 4 row by 4 column 
matrix, and other than the case of the arrangement 
shown in Fig. 2A, the distributions of weighting coeffi- 
cients for weighted average processing to color filters 
correspond to the other distributions in Figs. 2B to 2E, 
respectively. 

As described above, according to this embodiment, 
CCD portion 10 performs an all pixel-separately read 
out operation. More specifically, corresponding to an 
arrangement in which color filters Ye and Cy are alter- 
nately arranged in the horizontal direction (y-direction) 
in the 0-th line in the vertical direction (x-direction) as 
shown in Fig. 2A, Ye and Cy are alternately output as 
read out signals from CCD portion 10 for a scanning line 
corresponding to the line. In the next 1st line (corre- 
sponding to x=1), signals G and Mg are alternately out- 
put. 

Fig. 3 is a block diagram showing in further detail 
the configurations of scanning line delay devices 18, 20 
and 22 and two-dimensional register array 30 which 
receive a read out signal from such CCD portion 10 in 
the configuration shown in Fig. 1 . 

Two-dimensional register array 30 includes a regis- 
ter 302 which receives an output from frame memory 50 
holding an output signal from A/D converter 16 and out- 
puts a 1 clock delayed signal d01, and a register 304 
which outputs a signal d02 1 clock delayed from 
received signal d01. 

Two<limensional register array 30 further includes 
a register 306 which outputs a signal dll 1 clock 
delayed from signal dlO received from scanning line 
delay device 18, a register 308 which outputs a signal 
d12 1 clock delayed from received signal d11, a register 
310 which outputs a signal d13 1 clock delayed from 
received signal d12, a register 312 which outputs a sig- 
nal d21 1 clock delayed from a signal d20 received from 
scanning line delay device 20, a register 314 which out- 
puts a signal d22 1 clock delayed from received signal 
d21 . a register 316 which outputs a signal d23 1 clock 
delayed from received signal d22, a register 318 which 
outputs a signal d31 1 clock delayed from a signal 
received from scanning line delay device 22. and a reg- 
ister 320 which outputs a signal d32 1 clock delayed 
from received signal d31 . 

More specifically, two-dimensional register array 30 
converts signals serially read out from CCD portion 10 
such that signals from photoelectric conversion ele- 
ments corresponding to pixels in a 4 row by 4 column 
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matrix are output in parallel. 

More specifically, signals dot to d32 described 
above correspond to expressing output signals from 
photoelectric conversion elements corresponding to 
pixels (x, y) in CCD portion 10 using symbols d, x and y. 5 

Fig. 4 is a block diagram showing in further detail 
the conf iguration of interpolation processing circuit 34 in 
Fig. 1. 

Interpolation processing circuit 34 includes an inter- 
polation operation portion 342 which receives signals 10 
d12, d10 and d32 and outputs a first interpolation sig- 
nal, an interpolation operation portion 344 which 
receives signals d11, dl3 and d31 and outputs a sec- 
ond interpolation signal, an interpolation operation por- 
tion 346 which receives signals d21, d01 and d23 and is 
outputs a third interpolation signal, an interpolation 
operation portion 348 which receives signals d22, d02 
and d20 and outputs a fourth interpolation signal, and a 
selecting circuit 350 controlled by a control circuit 42 to 
output the first to fourth interpolation signals as green 20 
signal G, cyan signal Cy. magenta signal Mg and yellow 
signal Ye, respectively. 

Herein, interpolation operation portion 342 includes 
a multiplier 3422 which doubles the amplitude of 
received signal d21 for output, an adder 3424 for output- 25 
ting the result of adding signal dlO and signal d32, and 
an adder 3426 for outputting the result of adding the 
amplitudes of outputs from adder 3424 and multiplier 
3422 as the first interpolation signal. Interpolation oper- 
ation portions 344, 346 and 348 have basically the 30 
same configuration as interpolation operation portion 
342, besides they receive different signals. 

Therefore, when color filters are arranged as shown 
in Fig. 2A, interpolation operation portions 342, 344, 
346 and 348 correspond to weighted average process- 35 
ings based on the arrangements of weighting coeffi- 
cients shown in Figs. 2C, 2B, 2D and 2E, respectively. 

Selecting circuit 350 responds to the least signifi- 
cant bit h-addLSB of horizontal address HA and the 
least significant bit v-addLSB of vertical address VA rep- 40 
resenting the present reading position in CCD portion 
10 output from control circuit 42 to switch the corre- 
spondence between the first to fourth interpolation sig- 
nals and green signal G,, cyan signal Cy, magenta signal 
Mg and yellow signal Ye for output. 45 

If color filters are arranged as shown in Hg. 2A, for 
example, selecting circuit 350 outputs signals such that 
the first interpolation signal corresponds to green signal 
G, the second interpolation to magenta signal Mg, the 
third interpolation signal to cyan signal Cy and the so 
fourth interpolation signal to yellow signal Ye. 

If the arrangement of color filters corresponding to 
pixels in a 4 row by 4 column matrix from which signals 
are read out changes, selecting circuit 350 changes the 
above-described corresponding relation accordingly. 55 

By the above-described operation of interpolation 
processing circuit 34, for each of green signal G, cyan 
signal Cy, magenta signal Mg and yellow signal Ye, a 



signal corresponding to the central position of pixels in 4 
row x 4 column matrix are generated by prescribed 
weighted average processings to signals read out from 
photoelectric conversion elements corresponding to the 
pixels in the 4 row by 4 column matrix. 

Fig. 5 is a graph showing the frequency character- 
istics of output signals Ye+G, Cy+Mg, G+Cy and Ye+Mg 
when interpolation processings are implemented using 
a digital filter as shown in Fig. 3, in contrast to Fig. 14. 

The frequency characteristics of output signals 
Ye+G, Cy+Mg, G+Cy and Ye+Mg are virtually the same 
up to the vicinity of the 1/2 Nyquist frequency as a result 
of interpolation processing. Therefore, if color difference 
signals Cb and Cr are obtained by a color separation 
processing based on these signals, unwanted false 
color signals can be restricted, which leads to improve- 
ment in the picture quality. 

Note that in the foregoing, the interpolation 
processings by the weighted average processing of the 
arrangements of weighting coefficients shown in Figs. 
2B to 2E are performed to output signals from photoe- 
lectric conversion elements corresponding to pixels in a 
4 row x 4 column matrix, but the invention is not limited 
to such a case. For example, pixels to be subjected to 
such an interpolation processing may be pixels in a k 
row by k column matrix if k is an even number. 

Four sets of weighting coefficients of the weighted 
average, each corresponding to one of four color sig- 
nals, in other words, green signal, cyan signal, magenta 
signal and yellow signal, need only be arranged in such 
a way that the arrangement of one of the four sets cor- 
responds to one of the arrangements of the rest at every 
90° rotation around the central position. 

Furthermore, the color signals are not necessarily 
limited to the green signal, cyan signal, magenta signal 
and yellow signal, and the invention is applicable to 
combinations of other color signals such as a combina- 
tion of YM, CG, YG and CM used for color f ilters accord- 
ing to the frame color difference sequential system. 

Fig. 6 is a block diagram showing in further detail 
the configuration of color signal generation circuit 36 
shown in Fig. 1. 

Referring to Fig. 6, color difference signal genera- 
tion circuit 36 includes an adder 362 which adds 
received yellow signal Ye and magenta signal Mg, an 
adder 368 which adds the amplitudes of received green 
signal G and cyan signal Cy, a multiplier 347 which mul- 
tiplies the output of adder 368 by -1, and an adder 376 
which adds the output of adder 362 and the output of 
multiplier 374 to output a signal Cr. 

Color difference signal generation circuit 36 further 
includes an adder 364 which adds received magenta 
signal Mg and cyan signal Cy, an adder 366 which adds 
the amplitudes of received green signal G and yellow 
signal Ye, a multiplier 372 which multiplies the output of 
adder 366 by -1, and an adder 370 which adds the out- 
put of adder 364 and the output of multiplier 372 to out- 
put a signal Cb. 
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More specifically, color difference signal separation 
circuit 36 generates color difference signals Cb and Cr 
from green signal G, cyan signal Cy, magenta signal Mg 
and yellow signal Ye by the following operation process- 
ings: 5 



Cb=(Cy+Mg)-(Ye+G) 
=(R+G+2B)- (R+2G) = 2B-G 



Cr=(Ye+Mg) - (G+Cy) 
= (2R+GM-B)- (B+2G) = 



2R-G 



(14) 



(15) 



Generating Luminance Sional and Aperture Signal 

Herein, the luminance signal may be generated by 
the following operation with green signal G, cyan signal 
Cy. magenta signal Mg and yellow signal Ye obtained by 
the above-described interpolation processing. 

Y= ( Cy+Mg) + (Ye +G) (1 6) 

= (R+G+2B) + (R+2G)=2R+3G+2 

The luminance signal may be generated by an 
operation based on the above expression directly from 
signals corresponding to pixels in a 2 row x 2 column 
matrix surrounding the central position among signals 
from photoelectric conversion elements corresponding 
to the pixels in a 4 row x 4 column matrix. More specifi- 
cally, in this case, luminance signal Y is generated 
according to the same method as the conventional color 
separation method described in conjunction with Fig. 
13. 

Unwanted false color signals may be restricted by 
the interpolation processing, but the resolution may 
deteriorate because of the interpolation. Human eyes 
are more sensitive to luminance information than color 
information, and therefore luminance signal Y obtained 
without the interpolation processing may be directly 
used in order to restrict a deterioration in the resolution 
sensed by human eyes. 

This is also true to generation of an aperture signal 
for aperture correction. More specifically, a luminance 
signal used as a base for generating an aperture signal 
desirably has a resolution as high as possible, and use 
of a signal after an interpolation processing also causes 
a deterioration in the resolution. 

Fig. 7 is a first schematic diagram for use in illustra- 
tion of the procedure of generating luminance signal Y 
as described above and an aperture signal AR Fig. 8 is 
a second schematic diagram showing the procedure of 
generating aperture signal AR 

Referring to Fig. 7, signals Y01, Y10, Y1 1, Y12 and 
Y21 are generated by the following operations: 

Y01 = Ye02+Cy01+Mg1 1+G12 (17) 

Y10 = Ye20+Cy21+Mg11+G10 (18) 



Y11 = Ye22+Cy21+Mg11+G12 (19) 
Y12 = Ye22+Cy23+Mg13+G12 (20) 
Y21 = Ye22+Cy21+Mg31+G32 (21) 



More specifically, Y11 corresponds to luminance 
signal Y Signals Y01 , Y10, Y12 and Y21 are generated 
from signals from photoelectric conversion elements 
10 corresponding to pixels in a 2 row by 2 column matrix 
including two of the pixels in the 2 row x 2 column matrix 
in the center used to generate Y1 1 . 

Now, referring to Fig. 8, aperture signal AP is gen- 
erated by the following operation based on thus gener- 
75 ated signals Y01, Y10, Y1 1, Y12 and Y21. 



AP = 4xY11-Y01-Y10-Y12-Y2T 



(22) 



Fig. 9 is a schematic diagram showing in more 
20 detail the configuration of luminance signal generation 
circuit 32 and aperture signal generation circuit 38 
shown in Fig. 1 . 

Luminance signal generation circuit 32 includes an 
adder 322 which adds the amplitudes of received sig- 
25 nals d1 1 and d21 , an adders 324 which adds the ampli- 
tudes of received signals d12 and d22, and an adder 
326 which adds the amplitudes of outputs received from 
adders 322 and 324 to output luminance signal Y (Y1 1). 
Aperture signal generation circuit 38 includes an 
30 adder 382 which adds received signals d01 and d1 1 , an 
adder 386 which adds received signals d02 and d12, an 
adder 384 which adds outputs received from adders 
382 and 386, an adder 388 which adds received signals 
d10 and d20, an adder 392 which adds outputs received 
35 from adder 388 and adder 322 in luminance signal gen- 
eration circuit 32, and an adder 390 which adds the out- 
puts of adders 384 and 392. 

Aperture signal generation circuit 38 further 
includes an adder 398 which adds received signals d21 
40 and d3 1 , an adder 402 which adds received signals d22 
and cJ32, an adder 400 which adds outputs received 
from adders 398 and 402, an adder 396 which adds 
received signals d13 and d23, an adder 394 which adds 
outputs received from adder 396 and adder 324 in lurni- 
45 nance signal generation circuit 32, an adder 404 which 
adds the outputs of adders 394 and 400, an adder 406 
which adds the outputs of adders 390 and 404, a multi- 
plier 410 which multiplies the output of adder 406 by -1 , 
a multiplier 408 which multiplies luminance signal Y by 
so 4, and an adder 412 which adds outputs received from 
multipliers 408 and 410 to output signal AR 

More specifically, luminance signal generation cir- 
cuit 32 outputs luminance signal Y based on an opera- 
tion represented by expression (19). while aperture 
55 signal generation circuit 38 generates aperture signal 
AP by operations based on expressions (17) to (22) for 
output. 

In the foregoing structure, when aperture signal AP 
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is generated, luminance signal Y based on signals from 
photoelectric conversion elements corresponding to 
pixels in a 2 row by 2 column matrix surrounding the 
central position in a 4 row by 4 column matrix is used, 
and therefore a deterioration in the resolution caused by 5 
interpolation processing may be restricted. 

Although the present invention has been described 
and illustrated in detail, it is clearly understood that the 
same is by way of illustration and example only and is 
not to be taken by way of limitation, the spirit and scope 16. 
of the present invention being limited only by the terms 
of the appended claims. 

Claims 

1 . A 1 -chip digital color camera comprising : 

solid-state imaging means having an array of 
photoelectric conversion elements each corre- 
sponding to a pixel, so 
said solid-state imaging means including a 
color filter array in which a green filter and first 
to third complementary color filters are 
arranged corresponding to said photoelectric 
conversion elements in a mosaic according to a 25 
color difference sequential system, 
said digital color camera further comprising 
color separation means (100) receiving the out- 
put of said solid-state imaging means for gen- 
erating color data corresponding to the central 30 
position in an arbitrary k row by k column matrix 
(k: an even number), 
said color separation means including, 
color interpolation means (34) for producing 
the weighted average of outputs from photoe- 35 
lectric conversion elements, at which corre- 
sponding color filters are arranged among 
outputs from the plurality of said photoelectric 
conversion elements corresponding to the pix- 
els in said k row by k column matrix depending 40 
upon an arrangement of said color filters to 
generate each of green and the first to third 
complementary color signals, and 
first operation means (36) receiving outputs 
from said color interpolation means for separat- 45 
ing color data corresponding to said central 
position. 

2. The 1-chip digital color camera as recited in claim 

1, wherein so 

in the weighted average processing by said 
color interpolation means, 
four sets of weighting coefficients of said 
weighted average, each corresponding to one 55 
of said green and said first to third complemen- 
tary color signals, are arranged in such a way 
that an arrangement of one of said four sets 



corresponds to one of arrangements of the rest 
at every 90° rotation around said central posi- 
tion. 

3. The 1 -chip cfigital color camera as recited in claim 
2, wherein 

said color filter array includes a plurality of first 
rows and a plurality of second rows alternately 
arranged, 

each said first row includes green filters and 
first complementary color filters alternately 
arranged, and 

each said second row has second complemen- 
tary color filters and third complementary color 
filters alternately arranged. 

4. The 1-chip digital color camera as recited in claim 
2, wherein 

said color separation means further includes 
conversion means (18, 20, 22) lor converting 
received signals serially output for each row in 
the array of said photoelectric conversion ele- 
ments into parallel signals for each of said k 
rows, and 

first holcfing means (30) receiving the output of 
said conversion means for holding signals for a 
k row by k column matrix, and 
said color interpolation means performs 
weighted average processing based on the sig- 
nals held by said holding means. 

5. The 1-chip cfigital color camera as recited in claim 
4, further comprising second holding means (50) 
receiving the output of said solid-state imaging 
means for holding output signals from even rows 
and odd rows in the array of said photoelectric con- 
version elements for 1 image frame, and applying 
said held signals to said conversion means. 

6. The 1-chip cfigital color camera as recited in claim 
2, wherein 

said even number k is 4. 

7. The 1-chip cfigital color camera as recited in claim 
6, wherein 

said color separation means includes second 
operation means (32) for adding outputs from 
said photoelectric conversion elements in the 2 
row by 2 column matrix surrounding said cen- 
tral position among outputs from said photoe- 
lectric conversion elements corresponding to 
the pixels in said 4 row by 4 column matrix to 
output a luminance signal. 
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8. The 1 -chip digital color camera as recited in claim 
6, wherein 

said color separation means further includes, 
conversion means for converting received sig- 
nals serially output for each row in the array of 
said photoelectric conversion elements into 
parallel signals for each said k rows, and 
first holding means for holding the output of 
said conversion means for holding signals in a 
4 row by 4 column matrix, and 
said color interpolation means performs a 
weighted average processing based on the sig- 
nals held by said holding means. 

9. The 1 -chip digital color camera as recited in claim 
8, further comprising second holding means receiv- 
ing the output of said solid-state imaging means for 
holding output signals from even rows and odd 
rows in the array of said photoelectric conversion 
elements for 1 image frame and applying said held 
signals to said conversion means. 

1 0. The 1 -chip digital color camera as recited in claim 
6, wherein 

when said first to third complementary colors 
are magenta, yellow and cyan, 
the outputs from the photoelectric conversion 
elements corresponding to the pixels in said 4 
row by 4 column matrix are D (x, y) (x = 0 to 3, 
y = 0 to 3), and a weighting coefficient corre- 
sponding to said D (x t y) is w (x, y), 
said interpolation average selectively performs 
one of a first weighted average processing, 
wherein w (1, 2) = 2, w = (1, 0) = 1 and w (3, 2) 
= 1, 

a second weighted average processing 
wherein w (1, 1) = 2, w = (3, 1) = 1 and w (1, 3) 
= 1, 

a third weighted average processing, wherein 
w (2, 1) = 2, w = (2, 3) = 1 and w (0, 1) = 1, and 
a fourth weighted average processing, wherein 
w (2, 2) = 2, w = (0, 2) = 1 , w (2, 0)= 1, depend- 
ing upon the arrangement of color filters corre- 
sponding to the pixels in said 4 row x 4 column 
matrix. 



luminance signal. 

12. The 1-chip digital color camera as recited in claim 
7, further comprising aperture signal generation 

5 means (38) for generating and outputting an aper- 

ture signal based on a first signal which is the sum 
of D (0, 1), D (0, 2), D (1. 1) and D (1, 2), a second 
signal which is the sum of D (1 , 0), D (1 , 1), D (2, 0) 
and D (2, 1), a third signal which is the sum of D (2, 

w 1), D (2, 2), D (3, 1) and D (3, 2), a fourth signal 
which is the sum of D (1 , 2), D (1 , 3), D (2, 2) and D 
(2, 3), and said luminance signal among the outputs 
from said photoelectric conversion elements corre- 
sponding to the pixels in said 4 row by 4 column 

is matrix, when the outputs from the photoelectric 
conversion elements corresponding to the pixels in 
said 4 row by 4 column matrix are D (x, y) (x = 0 to 
3, y = 0 to 3), and 

20 correction means (39) responsive to said aper- 

ture signal for performing aperture correction. 



25 



30 



35 



40 



45 



11. The 1-chip digital color camera as recited in claim 
10, wherein so 

said color separation means includes second 
operation means for adding outputs from said 
photoelectric conversion elements in the 2 row 
by 2 column matrix surrounding said central 55 
position among outputs from said photoelectric 
conversion elements corresponding to the pix- 
els in said 4 row by 4 column matrix to output a 



9 



EP 0 861 005 A2 



§l 



CO 
CO- 



* — * y — * 

1=1 





Cx3 
CO 


NO 






z; 








OJ 


E— 






OS -J 


-< 




OS 


03 -< 


OS 




O 


u. z; 


Cc3 




-O 


(A. CO 


z; 


e— 


CO 




Cx3 


fad 


CO 


o CO 


CO 


CO 



o 
o 



, CO" 



X 



TTTT 



^ co 



co co 

CU CO 

os W 

Cx3 CO 

c— o t— 
Zi OS ts*S 
i— a. co 



o 
co> 



I 



CO 
CO 

-o 
•a 

I 

CQ 
CO 

"O 

T3 
CO 
I 

















z: 






CO 


os 










CO 






z: 


CO >- 


1 


Cx3 


~ -ec 


co 




co os 










s 


OS 



o 



oo 
tt- 



cc 



<o 

CU — ■. 
OS f— 

co 

f— CxJ 
OS OS 
U3 OS e— 
O- CO t*S 

-< co co 







-< 




Z: 




CD 


CO 






CO 3C 


CO 


CO 




os 




:o 


-< 


e— 


OS 


OS 


cu 


Cz3 


5E 


Ol. 


to 




CO 



< 

- < 









CO 


CO 




z; 








z: -< 


OS 


■■— 55 


Cx3 


5ET CO 


z: I— 




£x3 US 


_J CO 


CO CO 



1 



^-3 
CO 
1 





>- 


to 


OS 




CO 




OS 


Cx3 







OO 



o 

CM 



CO 
CM 



CO 
CO 
-< 



CO 

<=> 

CO 



O 



CO fcQ 

co 

O- >- 

CO CO 



O' 



OS us 
to co 




10 



EP 0 861 005 A2 



FIG. 2 A 
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